In the Claims 

Claims 8-12 are currently amended. 
Claim 7 is cancelled. 

Claims 1-6 and 8-41 remain in the Application and are listed below. 

1 . (Original) A method comprising: 

describing one or more camera motions that occurred when sequential 
frames of a video were captured, the description for each said frame being 
provided by: 

a set of displacement curves that describe the one or more camera 
motions in respective horizontal (H), vertical (V), and radial (R) directions; 
and 

a mean absolute difference (MAD) curve that describes a minimum 
MAD value of the set of displacement curves; and 

detecting a shot boundary in the sequential frames by an abrupt transition of 
the minimum MAD values within the sequential frames, wherein the abrupt 
transition is indicated by a peak in the minimum MAD values described by the 
MAD curve. 

2. (Original) A method as described in claim 1, further comprising 
characterizing each of the described one or more camera motions as one of still, 
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camera shaking, irregular camera motion, and one or more regular camera 
motions. 

3. (Original) A method as described in claim 1, wherein the shot 
boundary is detected by examining a central said frame, denoted by k, of a sliding 
window containing N of said frames such that when each of the criteria defined by 
(a), (b), and (c) as follows are true for the minimum MAD value of the central said 
frame k , the abrupt transition is detected at the central said frame k: 

^ MAD(k) = max(MAD(i)\ i = k - N ! 2,..., k + N 1 2 . 

(b) MAD(k) > a l0W MAD sm + J3 . ^ 

(c) MAD{k)>a high ^^ + J3 

wherein a i0Wt a high and (3 are constants, and MAD sm is a second maximum of the TV- 
frames sliding window. 

4. (Original) A method as described in claim 1, further comprising 
generating the set of displacement curves by: 

comparing the sequential frames, one to another, utilizing an integral 
matching template to find matching pixels in respective said frames; 

determining displacement of the matching pixels in the compared 
sequential frames; and 
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describing the displacement utilizing the set of displacement curves. 



5. (Original) A method as described in claim 1, further comprising 
segmenting the video into a plurality of segments based on the detected shot 
boundary, each said segment having one or more said camera motions that are 
visually consistent. 

6. (Original) One or more computer-readable media comprising 
computer-executable instructions that, when executed, perform the method as 
recited in claim 1. 

7. (Cancelled) 

8. (Currently Amended) A method comprising: as described in claim 

[[7]] 

describing one or more camera motions that occurred when sequential 
frames of a video were captured, the description for each said frame being 
provided by a set of displacement curves that describe the one or more camera 
mo tions in respective horizontal (H), vertical (V), and radial (R) directions; and 

detecting camera shaking in the video based on the described camera 
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motions in the set of displacement curves, wherein the detecting includes defining 
motion energy E and variation Var based on the set of displacement curves. 



9. (Currently Amended) A method as described in claim 8 [[7]], 
wherein the detecting includes: 



video from the set of displacement curves, wherein the segment includes at least 
two of the sequential frames; 

finding a probabilistic distribution of camera shaking and non-shaking 
along E and Var axes; and 

determining whether the segment includes camera shaking from the 
probabilistic distribution. 

10. (Currently Amended) A method as described in claim 8 [[7]], 
wherein the camera shaking is detected for a segment of the video, denoted as tj to 
t 2 , having at least two of the sequential frames by: 

computing motion energy E and variation Var based on the set of 
displacement curves to find a distribution of shaking and non-shaking in E-Var 
space, wherein E and Var are computed as follows: 



computing motion energy E and variation Var for a segment of the 
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Var = — L-jpHv^&j* e {H,V,R} 

wherein " V" is a differential operator to compute relative variation; 
finding a probabilistic distribution of camera shaking and non-shaking 
along E and Var axes by: 

quantifying both the E axis and the Var axis to form a plurality of 
levels; and 

accumulating motion energy E and variation Var in respective said 
levels to form the probabilistic distribution; and 

determining whether the segment includes camera shaking from the 
probabilistic distribution by: 

computing average error probability P E wherein: 

Pe =P{s)l s P(x\S) dx+p(s)l s p(x\s) dx 
S is a hypothesis that the segment is shaking; 
S is a hypothesis that the segment is non-shaking; 
p ( s ) and are prior probabilities for existence of shaking 
and non-shaking, respectively; 

R s is a missed detection area; and 
Rs is a false detection area; and 
obtaining optimal decisions T E and T v based on a minimization of 
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P E by a likelihood ratio test wherein: 

if the segment satisfies optimal decisions T E and 7>, the 
segment includes camera shaking; and 

the optimal decisions T E and T v obtained as follows: 



1 1 . (Currently Amended) A method as described in claim 8 [[7]] further 
comprising generating the set of displacement curves by: 

comparing the sequential frames, one to another, utilizing an integral 
matching template to find matching pixels in respective said frames; 

determining displacement of the matching pixels in the compared 
sequential frames; and 

describing the displacement utilizing the set of displacement curves. 

12. (Currently Amended) One or more computer-readable media 
comprising computer- executable instructions that, when executed, perform the 
method as recited in claim 8 [[7]]. 

1 3 . (Original) A method comprising: 

describing one or more camera motions that occurred when sequential 
frames of a video were captured, the description for each said frame being 




s 
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provided by: 

a set of displacement curves that describe the one or more camera 
motions in respective horizontal (H), vertical (V), and radial (R) directions; 

a mean absolute difference (MAD) curve that describes a minimum 
MAD value of the set of displacement curves; and 

a MAJ curve that is a qualitative description of the one or more 
camera motions and is determined from the minimum MAD value of the 
MAD curve; and 

characterizing each of the described one or more camera motions as one of 
still, camera shaking, irregular camera motion, and one or more regular camera 
motions. 

14. (Original) A method as described in claim 13, wherein the 
qualitative description of camera motion includes still, horizontal, vertical and 
radial. 

15. (Original) A method as described in claim 13, further comprising 
generating the set of displacement curves by: 

comparing the sequential frames, one to another, utilizing an integral 
matching template to find matching pixels in respective said frames; 

determining displacement of the matching pixels in the compared 
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sequential frames; and 

describing the displacement utilizing the set of displacement curves. 

16. (Original) A method as described in claim 13, wherein the 
characterizing includes: 

morphological filtering of the set of displacement curves by: 

performing an opening operation to remove unstable motions from 
the set of displacement curves to form a set of regular motion displacement 
curves; and 

performing a closing operation on the set of regular motion 
displacement curves to connect interrupted regular motions to form a set of 
connected regular motion displacement curves; 

detecting shot boundaries based on the set of connected regular motion 
displacement curves; and 

merging overlap segments of the set of connected regular motion 
displacement curves to form one or more motion segments which describe regular 
camera motions that are included in at least two of the set of connected regular 
motion displacement curves. 

17. (Original) A method as described in claim 13, wherein the 
characterizing further comprises: 
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defining motion energy E and variation V based on the set of displacement 
curves to detect the camera shaking and the irregular camera motion; and 
detecting the still camera motion from the MAJ curve. 

18. (Original) A method as described in claim 13, wherein the one or 
more regular camera motions are selected from the group consisting of: 

panning; 

tilting; 

zooming; 

tracking; 

booming; 

dollying; and 

any combination thereof. 

19. (Original) One or more computer-readable media comprising 
computer-executable instructions that, when executed, perform the method as 
recited in claim 13. 

20. (Original) A method comprising: 

analyzing video having sequential frames to determine one or more camera 
motions that occurred when sequential frames of the video were captured; and 
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describing the one or more camera motions for each said frame by: 

a set of displacement curves that describe the one or more camera 
motions in respective horizontal (H), vertical (V), and radial (R) directions; 

a mean absolute difference (MAD) curve that relates a minimum 
MAD value from the set of displacement curves; and 

a major motion (MAJ) curve that: 

is generated from the minimum MAD value; and 

provides one or more qualitative descriptions that describe the 

one or more camera motions as one of still, vertical, horizontal and 

radial. 

21. (Original) A method as described in claim 20, further comprising 
detecting a shot boundary in the sequential frames from an abrupt transition of 
respective said minimum MAD values. 

22. " (Original) A method as described in claim 20, further comprising 
detecting a shot boundary in the sequential frames from an abrupt transition by 
examining a central said frame, denoted by k, of a sliding window containing N of 
said frames such that when each of the criteria defined by (a), (b), and (c) as 
follows are true for the minimum MAD value of the central said frame k , the 
abrupt transition is detected at the central said frame k: 
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^ MAD{k) = max(MAD(i)), i = k - N 1 2,...,k + N 1 2 . ' 

(b) MAD(k)>a low MAD sm+ /3. md 

(c) MAD(k)>a high ^^ + 0 

wherein a i0Wy a high and /?are constants, and MAD sm is a second maximum of the A-- 
frames sliding window. 

23. (Original) A method as described in claim 20, further comprising 
detecting camera shaking in the video by defining motion energy E and variation 
Var based on the set of displacement curves. 

24. (Original) A method as described in claim 20, further comprising 
detecting camera shaking by: 

computing motion energy E and variation Var for a segment of the 
video from the set of displacement curves, wherein the segment includes at least 
two of the sequential frames; 

finding a probabilistic distribution of camera shaking and non-shaking 
along E and Var axes; and 

determining whether the segment includes camera shaking from the 
probabilistic distribution. 
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25. (Original) A method as described in claim 20, further comprising 
detecting camera shaking for a segment of the video, denoted as t } to t 2 , having at 
least two of the sequential frames by: 

computing motion energy E and variation Var based on the set of 
displacement curves to find a distribution of shaking and non-shaking in E-Var 
space, wherein E and Var are computed as follows: 



wherein " V" is a differential operator to compute relative variation; 
finding a probabilistic distribution of camera shaking and non-shaking 
along E and Var axes by: 

quantifying both the E axis and the Var axis to form a plurality of 
levels; and 

accumulating motion energy E and variation Var in respective said 
levels to form the probabilistic distribution; and 

determining whether the segment includes camera shaking from the 
probabilistic distribution by: 




; and 




computing average error probability P E wherein: 




14 



o:\docs\MSl\17S4US\CA9780.DOC 



S is a hypothesis that the segment is shaking; 

s is a hypothesis that the segment is non-shaking; 

P(S) 

and p \ s ) are prior probabilities for existence of shaking 
and non-shaking, respectively; 

R s is a missed detection area; and 
Rs is a false detection area; and 
obtaining optimal decisions T E and 7> based on a minimization of 
P E by a likelihood ratio test wherein: 

if the segment satisfies optimal decisions T E and T v , the 
segment includes camera shaking; and 

the optimal decisions T E and T v obtained as follows: 

26. (Original) A method as described in claim 20, further comprising 
characterizing each of the described one or more camera motions as one of still 
camera motion, camera shaking, irregular camera motion, and one or more regular 
camera motions. 

27. (Original) A method as described in claim 26, wherein the one or 
more regular camera motions are selected from the group consisting of: 
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panning; 

tilting; 

zooming; 

tracking; 

booming; 

dollying; and 

a combination thereof. 

28. (Original) A method as described in claim 20, further comprising 
characterizing each of the described one or more camera motions as one or more 
regular camera motions by: 

morphological filtering of the set of displacement curves by: 

performing an opening operation to remove unstable motions from 

the set of displacement curves to form a set of regular motion displacement 

curves; and 

performing a closing operation on the set of regular motion 
displacement curves to connect interrupted regular motions to form a set of 
connected regular motion displacement curves; 

detecting shot boundaries based on the set of connected regular motion 
displacement curves; and 

merging overlap segments of the set. of connected regular motion 
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displacement curves to form one or more motion segments which describe regular 
camera motions that are included in at least two of the set of connected regular 
motion displacement curves. 

29. (Original) A method as described in claim 20, wherein the analyzing 
is performed by: 

executing a Mean Absolute Difference (MAD) algorithm based on 
luminance (L), wherein: 

luminance (L) is utilized to match pixels in respective first and 
second said frames; and 

the MAD between the first said frame, denoted as k, and the second 
said frame, denoted as k+1, is computed as follows: 

MAD(Ax)=— £ \L(x + Ax,k + l)-l(x,k] 
xgT 

wherein Tis a set of the matching pixels and "N" is a total number of 
the matching pixels; and 

estimating camera motion through error minimization in parameter state 
space (H, V, R), which respectively denote the horizontal, the vertical, and the 
radial directions, wherein: 

for each said direction (H, V, R), optimal matching is obtained when 

a minimum MAD is reached as follows: 
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(H, V, R) = argminMAD(Ax) 
Wis a state space of a plurality of camera motion candidates; and 
the camera motion candidate that yields a best match is an optimal 
estimation of camera motion. 

30. (Original) A method as described in claim 20, further comprising 
generating the set of displacement curves by: 

comparing the sequential frames, one to another, utilizing an integral 
matching template to find matching pixels in respective said frames; 

determining displacement of the matching pixels in the compared 
sequential frames; and 

describing the displacement utilizing the set of displacement curves. 

31. (Original) One or more computer-readable media comprising 
computer-executable instructions that, when executed, perform the method as 
recited in claim 20. 

32. (Original) A computer comprising: 
video having sequential frames; 

a set of displacement curves that describe one or more camera motions that 
occurred when sequential frames of a video were captured in respective horizontal 
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(H), vertical (V), and radial (R) directions; 

a mean absolute difference (MAD) curve that relates a minimum MAD 
value of the set of displacement curves for each said frame; and 

a major motion (MA J) curve that is a qualitative description of camera 
motion for each said frame and is determined from the minimum MAD value of 
the MAD curve; and 

a video analysis module this is executable to: 

detect a shot boundary in the sequential frames from an abrupt 
transition of respective said minimum MAD values; 

detect camera shaking in the sequential frames based on the 
described camera motions in the set of displacement curves; and 

characterize each of the one or more camera motions as one of still 
camera motion, camera shaking, irregular camera motion, and one or more 
regular camera motions. 

33. (Original) A computer as described in claim 32, wherein the video 
analysis module is executable to generate the set of displacement curves by: 

comparing the sequential frames, one to another, utilizing an integral 
matching template to find matching pixels in respective said frames; 

determining displacement of the matching pixels in the compared 
sequential frames; and 
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describing the displacement utilizing the set of displacement curves. 



34. (Original) A computer as described in claim 32, wherein the video 
analysis module is executable to: 

executing a Mean Absolute Difference (MAD) algorithm based on 
luminance (L), wherein: 

luminance (L) is utilized to match pixels in respective first and 
second said frames; and 

the MAD between the first said frame, denoted as k, and the second 
said frame, denoted as k+1, is computed as follows: 

MAD (Ax)=-1~ £ \L(x + Ax,k + l)~ L(x, k} 
N xeT 

wherein Tis a set of the matching pixels and "TV" is a total number of 
the matching pixels; and 

estimating camera motion through error minimization in parameter state 
space {H, V, R), which respectively denote the horizontal, the vertical, and the 
radial directions, wherein: 

for each said direction (H, V, R), optimal matching is obtained when 
a minimum MAD is reached as follows: 

(H,V,R) = argmnMAliiSx) 
iPis a state space of a plurality of camera motion candidates; and 
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the camera motion candidate that yields a best match is an optimal 
estimation of camera motion. 

35. (Original) A computer as described in claim 32, wherein the video 
analysis module is executable to detect the shot boundary by examining a central 
said frame, denoted by k, of a sliding window containing N of said frames such 
that when each of the criteria defined by (a), (b), and (c) as follows are true for the 
minimum MAD value of the central said frame k , the abrupt transition is detected 
at the central said frame k: 

^ MAD(k) = msnt(MAD(i)), i = k - N ! 2,..., k + N 1 2 . 

(b) MAD(k)>a l0W MAD sm+ fi, md 

N f,MAD{i) 

(c) MAD(k)>a high ^^ + P 

wherein ai ow> a^gh and are constants, and MAD sm is a second maximum of the A-- 
frames sliding window. 

36. (Original) A computer as described in claim 32, wherein the video 
analysis module is executable to detect camera shaking by defining motion energy 
E and variation Var based on the set of displacement curves. 

37. (Original) A computer as described in claim 32, 
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wherein the video analysis module is executable to detect camera shaking by: 



video from the set of displacement curves, wherein the segment includes at least 
two of the sequential frames; 

finding a probabilistic distribution of camera shaking and non-shaking 
along E and Var axes; and 

determining whether the segment includes camera shaking from the 
probabilistic distribution. 

38. (Original) A computer as described in claim 32, wherein the video 
analysis module is executable to detect camera shaking for a segment of the video, 
denoted as t } to t 2 , having at least two of the sequential frames by: 

computing motion energy E and variation Var based on and the set of 
displacement curves to find a distribution of shaking and non-shaking in E-Var 
space, wherein E and Var are computed as follows: 



wherein " V" is a differential operator to compute relative variation; 
finding a probabilistic distribution of camera shaking and non-shaking 



computing motion energy E and variation Var for a segment of the 




; and 
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along E and Var axes by: 

quantifying both the E axis and the Var axis to form a plurality of 
levels; and 

accumulating motion energy E and variation Var in respective said 
levels to form the probabilistic distribution; and 

determining whether the segment includes camera shaking from the 
probabilistic distribution by: 

computing average error probability P E wherein: 

Pr = HS)1 S P(* \S)dx + P(s)[ s p{x | S) dx 
Sis a. hypothesis that the segment is shaking; 
s is a hypothesis that the segment is non-shaking; 
p(s) 

and p \ s ) are prior probabilities for existence of shaking 
and non-shaking, respectively; 

R s is a missed detection area; and 

Rs is a false detection area; and 
obtaining optimal decisions T E and T v based on a minimization of 
P E by a likelihood ratio test wherein: 

if the segment satisfies optimal decisions T E and T v , the 
segment includes camera shaking; and 

the optimal decisions T E and T v obtained as follows: 
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39. (Original) A computer as described in claim 32, wherein the video 
analysis module is executable to characterize by: 

morphological filtering of the set of displacement curves by: 

performing an opening operation to remove unstable motions from 
the set of displacement curves to form a set of regular motion displacement 
curves; and 

performing a closing operation on the set of regular motion 
displacement curves to connect interrupted regular motions to form a set of 
connected regular motion displacement curves; 

detecting shot boundaries based on the set of connected regular motion 
displacement curves; and 

merging overlap segments of the set of connected regular motion 
displacement curves to form one or more motion segments which describe regular 
camera motions that are included in at least two of the set of connected regular 
motion displacement curves. 

40. (Original) A computer as described in claim 32, wherein the regular 
camera motions are selected from the group consisting of: 
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panning; 

tilting; 

zooming; 

tracking; 

booming; 

dollying; and 

a combination thereof. 

41. (Original) A computer as described in claim 32, wherein the video 
analysis module is executable to characterize by: 

defining motion energy E and variation V based on the set of displacement 
curves to detect the camera shaking and the irregular camera motion; and 

detecting the still camera motion from the MA J curve. 
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